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We study the spectra and eigenvectors of tlie adjacency matrices of scale-free networks when 
bi-directional interaction is allowed, so that the adjacency matrix is real and symmetric. The spec- 
tral density shows an exponential decay around the center, followed by power-law long tails at both 
spectrum edges. The largest eigenvalue Ai depends on system size iV as Ai ~ iV^/* for large iV, 
and the corresponding eigenfunction is strongly localized at the hub, the vertex with largest degree. 
The component of the normalized eigenfunction at the hub is of order unity. We also find that the 
mass gap scales as jV"*^'®*. 



PACS numbers: 05.10.-a, 05-40.a, 05-50. -hq, 87.18. Sn 



Complex systems such as social, biological, and eco- 
nomic systems consist of many constituents such as in- 
dividuals, substrates, and companies, respectively 0. 
Each constituent reacts and adapts to the pattern cre- 
ated in the system through diverse interactions. Cooper- 
ative phenomena between constituents in such complex 
systems may be described in terms of random graphs, 
consisting of vertices and edges, where vertices (edges) 
represent constituents (their interactions). The study of 
complex systems in terms of random graph was initiated 
by Erdos and Renyi (ER) [||. In the ER model, the 
number of vertices is fixed, and edges connecting from 
one vertex to another occur with probability p. Then 
there exists a probability threshold pc, above which the 
system is percolated. Recently Watts and Strogatz (WS) 
introduced the small-world network |^ to consider local 
clustering, while the number of vertices is also fixed. The 
WS model offers the first indication that real networks 
could be more complex than predicted by the ER model. 

Recently Barabasi and Albert (BA) Q introduced an 
evolving model where the number of vertices increases 
linearly with time rather than fixed, and a newly intro- 
duced vertex is connected to m already existing vertices, 
following the so-called preferential attachment rule that 
the vertices with more edges are preferentially selected for 
the connection to the new vertex. The number of edges 
k incident upon a vertex is the degree of the vertex. 
Then the degree distribution P{k) of vertices, equiva- 
lent to the connectivity distribution, follows a power-law 
P{k) - k-^ for the BA model, while for the ER and WS 
models, it follows a Poisson distribution. The BA model 
is interesting in a sense that a lot of complex interactive 
networks such as the world wide web 1^,^, the actor 
network , the citation network of scientific papers and 
the author collaboration network [Q, metabolic network 
1^ and food web |^ in biological systems all exhibit the 
power-law in the degree distribution, implying that a 
characteristic degree is absent in such systems. Thus the 
BA model is called a scale-free network. In the BA net- 
work, one may assign a direction on each edge pointing 



from the younger vertex to the older one |10(| . However, 
when the direction on each edge is ignored, allowing 
bi-directional interactions such as download and upload 
communications in Internet, the BA network may be re- 
garded as a simple model for the Internet topology ||lll| . 

While it is known that the BA network follows the 
power-law in its degree distribution, further structural 
properties are not so well known. When m = 1, the BA 
network forms a tree structure without forming any loop, 
but for TO > 1, loops are formed, and network topology 
becomes much complicated. So it would be interesting 
to investigate the spectrum of the BA network, because 
generally the spectrum of a random graph and corre- 
sponding eigenvectors are closely related to topological 
features of the random graph [p^p^. In this paper, we 
study the spectrum and the corresponding eigenvectors 
of the adjacency matrix of the BA network, comparing 
spectral properties with structural features. When a BA 
network is composed of A'^ vertices, the adjacency matrix 
A consists oi N x N elements, {aij} = 1, . . . ,N), 
defined as aij = 1 if vertices i and j are connected via 
an edge, and aij = otherwise, ki = Uij is the 
degree of the vertex i. In the BA model, the vertex 
with the largest degree is singled out and is called the 
hub, denoted by h hereafter, in this work. From previous 
studies H], we know that k^, the degree of the hub, scales 
as kh ~ m.N^/'^. The vertices are ordered in their ages; 
the vertex i is the one born at time i. 

Since we consider the bi-directional case (sometimes 
called the undirected case), the adjacency matrix A is 
real and symmetric, so that all eigenvalues are real and 
the largest eigenvalue is not degenerate. We obtained the 
spectrum of the BA network via exact diagonalization for 
N up to 5, 000 and for the first few largest eigenvalues, via 
the Lanczos method for N up to 400, 000. Through- 
out this paper, numerical simulations were carried out 
for TO = 2, the simplest case including the loop structure. 

Eigenvalues— We consider the distribution of the 



eigenvalues, shown in Fig.l. Analytic formula for the 
spectrum is not known yet, but one can easily see that 
the spectrum does not fit to the semi-circular equation 
derived by Wigner ||l3| appropriate to the ER random 
graph. The density of eigenvalues p(A) in the mid- 
dle part of the spectrum is likely to fit to the formula, 
p{X) ~ exp(— |A|/a) where a « 1.25 (see the left inset of 
Fig.l), while the density further out follows the power- 
law, p(A) ~ |A|~^, (see the right inset of Fig.l). Since the 
power-law decays much slower than the exponential one, 
the spectrum shows long tails at both spectrum edges 
(see Fig.l). Such behavior has also been observed in the 
financial time series [|l^ . 

The size dependence of the largest eigenvalue Ai is of 
interest and we found numerically that Ai increases as 
~ iV^/^ for large systems (see Fig. 2). To consider the 
relation between the largest eigenvalue Ai and the struc- 
ture of the BA network, we consider the foUowings. Let 
X and y be X 1 column vectors, related through 



(1) 



Let Vi^i be the z-th component of the normalized eigen- 
vector corresponding to the ^-th eigenvalue of A, A/, 
(Ai > A2 > . . . > Atv). Then Eq.(l) may be rewritten as 



(2) 



When we set Xj — 1 for some j and — Q for r ^ j ,yi (n) 
becomes the number of possible ways of n-step walks 
starting from the vertex j and terminating at the ver- 
tex i. This will be denoted as yj—,i{n) hereafter. In 
particular, when i = j, yj^j{n) is the number of possible 
ways to return to the starting vertex j after n-step walks. 
When n is sufficiently large, yj^i{n) can be represented 
in terms of the largest eigenvalue Ai alone as 



yj-,i{n) sa A"i;i,iUj,i. 
In particular, when i ~ j, 



(3) 



(4) 



Even though the relation Eq.(4) holds for any vertex 
j, we consider it particularly at the hub. Now let us con- 
sider the number of ways of n -I- 2 steps returning to the 
starting vertex h. It can be split into two parts, 

yh-,h{n -t- 2) = yh^h{n)yh^h{2) + ^yh^j{n)yj^h{2). 

(5) 

According to Eq.(4), 



yh->h{n) 



yh-.h{n) 



(6) 



where yh^h{2) corresponds to the degree of the hub, 
?/h_>/i(2) = m^/N, while yj^hi^) is found numeri- 
cally to behave as ~ ^0.05^^0.43^ weakly depending 
on A^ (see Fig. 3). The second term of the right hand 
side of Eq.(6) can be written using Eqs.(3) and (4) as 

Ej^h {■^)yj^h{2). We will show later that w 1/2, 

while Vj^i ^ {N j)^^/^ for j being away from h, leading to 
the result that the second term becomes ^^(A^^'^). Con- 
sequently, Ai is contributed dominantly by the first term 
in the right hand side of Eq.(6), leading to ~ im}/'^N'^/^. 

The result of Ai ^ N'^/'^ can also be understood 
through two toy models. First, one vertex is located at 
the center, and all the other A^— 1 vertices are linked only 
to the center vertex (Fig. 4a). This structure, called the 
radial structure, is an extreme case of "winner-takes-all" . 
The largest eigenvalue of this structure is Ai = ^/N —1, 
while the largest degree is A^ — 1. Second, we consider a 
two- level Cayley tree structure (Fig. 4b). When the coor- 
dination number is chosen as fc = -s/A, the total number 
of vertices becomes A^ -I- 1, and the largest degree v'A', 
as in the case of the BA network. The largest eigenvalue 
for this toy model is found to be Ai = \/2k — 1 ~ A^^^^. 
So, in both models, Ai ^ \/kh. 

The second largest eigenvalue in its absolute magni- 
tude is located on the negative side of the spectrum. 
The absolute magnitude of this eigenvalue |AAr| is also 
found to scale as |AAr| ~ N'^/^ (see Fig. 2). The difference 
between the first two largest eigenvalues in their abso- 
lute magnitude, Ai — |AAr|, is found to scale as ~ A^~*'.43 
(see the inset of Fig. 2). Thus, the mass gap, defined as 
log(Ai/|AAr|) 0, scales as - A^"^ with z k. 0.68. 

Next, we consider the size dependence of the mo- 
ments of the spectrum. First, since the matrix A 
is traceless, the first moment becomes zero, that is, 
M.I ~ X]f Ai = 0. Second, for each vertex, the num- 
ber of ways to return to the starting vertex by a 2-step 
walk is the same as the degree of that vertex, so that 
■^2 = Ef Af = 2mA^. Third, since the path to return 
to the starting vertex by a 3-step walk forms a triangle, 
the total number of triangles T/v in the system can be ob- 
tained through the third moment, AI3 = 'Y^f Af = OTat. 
We found numerically that 7W3 ~ iV^-^*^ (see Fig. 5). Note 
that while the first moment vanishes, the third moment 
does not, implying that the spectrum is not completely 
symmetric with respect to A = 0. 

Eigenvector— Since the adjacency matrix A is real 
and symmetric, every component of the eigenvector cor- 
responding to the largest eigenvalue is positive. Since the 
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largest eigenvalue and the corresponding eigenfunction 
is important, as in the case of Eq.(3), we focus on the 
eigenvector for the largest eigenvalue. We con- 

sider the square of each component of the eigenvector 
{v^ i} instead of {wj.i} itself because of the normaliza- 
tion, "^jVji — 1, and compare it with the normalized 
degree of each vertex {kj/ J^i ^i}- As seen in Fig. 6, the 
two quantities are correlated in such a way that up-down 
behavior occurs in a similar fashion. 

The components {^'lil {j — 1, . . • ,N) is strongly lo- 
calized at the hub. This is in contrast to the ER case 
where the corresponding eigenfunction is extended over 
all vertices (see the inset of Fig. 6). We found that ^ 
at the hub increases with increasing N for small N, but 
converges to a constant close to 1/2 for large N (see 
Fig. 7). The value 1/2 can be obtained from the radial 
structure analytically. Since the radial structure is the 
extreme case that the connectivity is mostly localized 
at the hub, the value 1/2 can become the upper bound 
of vfi^^. The result that ^ approaches a constant as 
TV ^ oo is interesting, because ^ behaves differently 
from the normalized degree at the hub, decreasing as 
~ (see Fig.7). Since the number of returning n- 

step walks from a vertex j is yj^j (n) oc x;| from Eq.(4), 
v'j I can be considered as a measure of contribution from 
the vertex j to transport processes in a network. The fact 
that vf^ ^ 0{1) can be interpreted as that the hub plays 
much more dominant role in transports on the BA net- 
work, compared with the contribution measured by the 
normalized degree at the hub, which is 0{1/Vn). Thus, 
the presence of the hub in the scale-free networks diver- 
sifies pathways, and enhances the efficiency of transport, 
while the network systems are vulnerable to the attack on 
the hub On the other hand, for other components 

of the eigenfunction, {vj i}, {j ~ 1, . . . , TV, but j ^ h), 
it was found numerically that ~ l/A^/Nj (see Fig. 8). 

Each component of eigenvectors can be obtained 
through the diagonalization of the adjacency matrix A. 
However, the eigenfunction for Ai can be obtained using 
the relation, Eq.(4). The knowledge of yj^j{n) and Ai 
enables one to obtain each component of the eigenfunc- 
tion through Wji ~ Vj-tjif^) / ^1 for sufficiently large n. 
However, when n is not large enough, yj—>j (n) for vertex 
j is affected by local topology around j, so that the value 
of Vj I obtained by this method would be different from 
that by the exact diagonalization. Thus, we can define a 
characteristic number of steps ric, such that for n > Uc, 
Eq.(4) holds, while for n < ric, it breaks down. To find 
ric, we introduce the quantity, 

H i:(^ -«?,.) I . m 

which is found to decay exponentially as (5„ ^ 
exp(— n/ric) (see the inset of Fig. 9). We found numer- 
ically that Tic shows a crossover across a characteristic 



system size Nc such that for N < Nc, ric ^ while 
for TV > TVc, Uc ~ TV°-5° (see Fig.9). On the other 
hand, Eq.(7) may be rewritten as Sn = \ J2i>ii^i/ ^iT^l- 
Then, for sufficiently large n, Sn is contributed domi- 
nantly by the term (|AAr|/Ai)" alone. Combined with 
Sn ~ exp(— n/rtc), one obtains that ric = Ai/(Ai — |AAr|), 
equivalent to the inverse of the mass gap. Thus, ric ~ TV^. 
However, the numerical value of the exponent z obtained 
in this way, z « 0.50, deviates from the value z « 0.68 
obtained by the direct measurement of Ai — lAjvl. This 
can be attributed to the fact that Sn includes contribu- 
tions from other eigenvalues. 

Shortest paths— Since the role of the hub in transport 
is much more dominant, compared with the contribution 
by the normalized degree, we also study topological fea- 
ture of shortest paths between two vertices [|9|. The 
transport from one position to another is mainly car- 
ried along the shortest path(s) between them, and is 
contributed dominantly by the largest eigenvalue of the 
adjacency matrix A. We define a set, composed of the 
vertices on the shortest path(s) from one position to an- 
other. Then, since there are TV(TV— 1)/2 pairs of vertices, 
the same number of sets exist in the system. Among 
them, we are interested in how many number of different 
sets a certain vertex j belongs to. This number is called 
the involving number Pj , while the normalized involving 
number is defined as pj = Pj/^iPi for each vertex j. 
Fig. 6 also shows pj versus j. It behaves similarly to 
the up-down behavior of w| and kj . In particular, the 
involving number at the hub Ph is found numerically 
to scale as Ph ~ TV^, while the total involving number 
summed over all vertices is found numerically to scale as 
Ej^i Pj - log TV (see Fig.lO) |§. So the normalized 
involving number at the hub ph = Ph/ J2j Pj behaves 
as Ph ~ 1/ log TV, decaying much more slowly, compared 
with the normalized degree decreasing as ^ TV^*^'^. This 
weak dependence on TV is comparable to the result that 
Vh.i ^ C'(l) for large TV. Therefore, the contribution of 
the hub to shortest paths is much larger than that of the 
naive estimate based on the normalized degree at the 
hub, 0(1/VtV). 

In conclusion, we have considered the spectrum and 
eigenvectors of the adjacency matrix of the BA network, 
when bi-directional interaction is allowed. The density 
of the eigenvalues decays exponentially for small |A|s, fol- 
lowed by power-law tails at both spectrum edges. This 
is diff'erent from the Wigner's formula appropriate to 
random graphs. We found that the largest two eigen- 
values Ai and |AAr| depend on system size TV as ~ TV^/* 
for large TV, and the mass gap scales as TV~°-^^. The 
eigenfunction corresponding to the largest eigenvalue Ai 
is strongly localized at the vertex with the largest degree, 
called the hub. The component of the normalized eigen- 
function for Ai at the hub is independent of TV, implying 
that the role of the hub in transport on the scale-free 
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network becomes much important for larger system, and 
its contribution becomes much more dominant than ex- 
pected according to the normahzed degree at the hub, 
which scales as N~^^'^. Therefore, it is very efficient in 
communication networks to construct central vertices, 
through which most of information traffic pass. 
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FIG. 1. Plot of the density of eigenvalues of the adjacency 
matrix A versus eigenvalues for system size N — 5, 000 av- 
eraged over 40 configurations. Left inset: Semi-logarithmic 
plot of the density versus eigenvalues to show the exponential 
decay for small |A|s. Right inset: Double logarithmic plot of 
the density versus eigenvalues to show the power-law decay 
at spectrum edge. 
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FIG. 2. Double logarithmic plot of the first two largest 
eigenvalues Ai (o) and |Ajv| (□) versus system size A'^. The 
dashed line has slope 0.25, drawn for the eye. Inset: Double 
logarithmic plot of the difference, Ai — |Ajv|, versus system 
size A'". 
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FIG. 3. Double logarithmic plot of yj^h{'2)/N'^'"'' versus j 
for different systems N = 1, 000, 5, 000 and 10, 000. The slope 
at the tail is estimated to be —0.43. 
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FIG. 4. The radial structure (a), and the two- level Cayley 
tree structure with the coordination number k = 4 (b). 
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FIG. 5. Double logarithmic plot of the second and the third 
moments M.2 and Ms versus system size N. The dotted 
(solid) line has slope 1.0 (0.40), drawn for the eye. 
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FIG. 6. Plots of Vj i (o), the normalized degree kjf^.ki 
(□), and the normalized involving number pj (O) versus ver- 
tex index j for A'^ = 10^. Inset: The eigenfunction correspond- 
ing to the largest eigenvalue for the ER random network for 
N = 10^, showing that the eigenfunction is extended. 




FIG. 7. Double logarithmic plot of ^ and the normalized 
degree kh / j versus system size N. The dot- 

ted line 0.5 is an asymptotic line of v^ i- The dashed line for 
the normalized degree has slope —0.5, drawn for the eye. 




FIG. 8. Double logarithmic plot of i versus j for 
iV = 400,000. The dashed hne has slope -0.5, drawn for 
the eye. 
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FIG. 9. Double logarithmic plot of ric versus system size 
N . The dashed line has slope 0.35 up to Nc ~ 5, 000, and 
0.50 beyond A^c, drawn for the eye. Inset: Semi-logarithmic 
plot of 5n versus number of steps n. 
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FIG. 10. Semi-logarithmic plot of P^/iV^ and ■ Pj/^'^ 
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